Skip to content

issue/244 feat(llm): add prefix cache reuse for static KV cache#262

Merged
wooway777 merged 1 commit intomainfrom
issue/244
Mar 10, 2026
Merged

issue/244 feat(llm): add prefix cache reuse for static KV cache#262
wooway777 merged 1 commit intomainfrom
issue/244

Conversation

@ma-hang
Copy link
Contributor

@ma-hang ma-hang commented Mar 9, 2026

No description provided.

@ma-hang ma-hang requested review from a team, Ceng23333 and wooway777 March 9, 2026 06:52
@ma-hang ma-hang linked an issue Mar 9, 2026 that may be closed by this pull request
@wooway777 wooway777 merged commit 22711ec into main Mar 10, 2026
@wooway777 wooway777 deleted the issue/244 branch March 10, 2026 06:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DEV] 推理服务static cache支持缓存复用

3 participants